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Abstract 

We present a self-organising, decentralised control method for material flows in 
networks. The concept applies to networks where time sharing mechanisms be- 
tween conflicting flows in nodes are required and where a coordination of these 
local switches on a system- wide level can improve the performance. We show that, 
under certain assumptions, the control of nodes can be mapped to a network of 
phase-oscillators . 

By synchronising these oscillators, the desired global coordination is achieved. We 
illustrate the method in the example of traffic signal control for road networks. The 
proposed concept is flexible, adaptive, robust and decentralised. It can be transferred 
to other queuing networks such as production systems. Our control approach makes 
use of simple synchronisation principles found in various biological systems in order 
to obtain collective behaviour from local interactions. 
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1 Introduction 



Efficient control of multiple material flows on a system wide level is one of the 
most challenging problems in complex socio-technical transportation systems. 
For the majority of all material flow systems, a parallel service of several inter- 
secting flows or conflicting tasks is impossible, unsafe or inefficient. Alternating 
exclusion of competing tasks is frequently observed at crossroads in road traffic 
[1,2,3,4,5,6,7], in the organisation of production processes [8,9,10,11] or in com- 
munication networks [12,13]. Instead of parallel processing of different flows, 
a sequential processing must be organised in an optimal manner. Whereas the 
setup of optimal schedules for single nodes is usually done by traditional op- 
timisation techniques, the control problem on a network-wide level becomes 
often practically unsolvable by these methods, especially in larger networks. 
Moreover, most of the material flow networks are subject to continuous de- 
mand variations and unforeseen failures. Besides adaptivity and optimality, 
robustness and flexibility are important requirements for control concepts. 
Can we learn from the stable, smooth, and efficient flow of nutrients and other 
chemical substances in circulatory systems of biological organisms? Synchro- 
nised dynamics of a population of cells often plays an important role for it 
[14,15,16]. For example, our heart functions as a pump through the appropriate 
synchronised dynamics of a population of cardiac cells. This synchronisation is 
realised through appropriate designs of cardiac cells and their network archi- 
tecture of local interactions. Another interesting example is found in amoeboid 
organisms [17,18], where the rhythmic contraction pattern produces stream- 
ing of protoplasm. Synchronisation phenomena have been intensively studied 
for these biological systems during the last decades by means of mathemati- 
cal models, in particular coupled phase-oscillator models [14,19,20,21,22]. The 
great advantage of phase-oscillator models are their tractability and univer- 
sality. 

In the present paper, we take advantage of this tractability and propose a 
decentralised control principle for material flow networks with transportation 
delays and setup-times, based on the phase-synchronisation of oscillatory ser- 
vices at the network nodes. 



1.1 Decentralised control using phase- synchronisation 

Let us consider a material transport network, which is a directed graph with 

of a set of nodes and links. Material can move between the nodes with a flnite 
velocity. Thus, any element experiences a delay tij between its departure at 
one node i and its arrival at the next node j. Whereas a distinct subset of 
nodes may act as a source or sink of moving material, we shall concentrate on 
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those nodes where the flow of material is conserved, i.e. 

j:r=j:q^-\ (1) 



Here J2 Q'™ and J2 9°"* denote the average rate of incoming and outgoing mate- 
rial, respectively. Each node has to organise the routing of materials arriving 
through incoming links towards its outgoing links. All allowed connections be- 
tween incoming and outgoing links can be described through discrete states 
of the respective node. As long as such a state is 'active', material can flow 
from a subset of incoming links through the node and leave through outgo- 
ing hnks. All other flow relations are blocked. Usually the switching between 
different discrete states needs a certain time interval r, called switching- or 
setup-time. Depending on the flow rates, the duration of these discrete states 
may vary. Since we assume a cyclic service sequence, we can assign a periodic 
motion to every switching node. Thus, a node can be modelled as a hybrid 
system consisting of a phase-oscillator and a piecewise constant function M 
that maps the continuous phase-angle (f{t) to the discrete service state s{t), 
e.g. M : ifit) ^ s{t). 

The switched service of different flows leads to convoy formation processes. 
This implies highly correlated arrivals at subsequent nodes, which requires 
to optimise M with respect to a minimal delay of the material. Whereas the 
map M can be optimised according to the actual local demand, the phase- 
angle (p is coupled to the oscillatory system of the neighbouring nodes. Thus, 
with a suitable synchronisation mechanism we can achieve a coordination of 
the switching states on a network-wide level. In consequence, we suggest an 
adaptive decentralised control concept consisting of two parts: 

(a) Phase-synchronisation of all oscillators in the network, based on local 
coupling between immediate neighbours. 

(b) Mapping of phase-angles to the switching states based on local optimisa- 
tion. 

For the sake of concreteness, we apply our method to the control of traffic 
lights at intersections of road networks. The rest of this paper is organised as 
follows: At first, in Sec. 2 we propose a hybrid phase-oscillator model for the 
intersections of a road network. In Sec. 3 we discuss the synchronisation of 
the oscillators by a suitable local coupling mechanism for arbitrary network 
architectures. Finally, in Sec. 4 we show how an optimal switching of green and 
red traffic light phases with respect to minimum delay times can be reached, 
based on local adjustment and optimisation. 
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Fig. 1. A single intersection adjusts the mapping of the phase-angle to the 
switching states s locally. Within a complete cycle, each state s is sequentially 
activated for a period Aips, during which the corresponding non-conflicting traffic 
lights are set to green. While switching from one state to another, all traffic lights 
are set to red for a period of Aip^°^^^. The phase-angle, at which a new cycle starts, 
is denoted by ip^. 



2 Hybrid model for traffic light control 

In the following, we introduce a hybrid oscillator model for a single traffic light 
controlled intersection and derive an upper bound for the allowed oscillator 
frequency. 



2. 1 Model of an intersection 

An intersection in road traffic is given by a set of traffic lights / G £, each 
one controlling the vehicular flow of a single or several lanes. If two driving 
paths intersect, we call the related green lights conflicting. We require that 
conflicting traffic lights are not set to green at the same time. In order to 
increase the throughput of an intersection, non-conflicting traffic lights can be 
switched collectively. Such a collective switching of a subset Cs d C oi traffic 
ligths corresponds to one discrete state s G {1, 2, . . . S*} of the intersection. An 
explanatory sketch of this model is shown in Fig. 1. 

While the phase-angle of the oscillator modelling the intersection progresses 
from to 27r at the rate tu, all states s are sequentially activated for some period 
^(Ps- Thus, all traffic lights in the subset Cs are set to green for this interval 
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A<^5 whereas the remaining hghts / G £ \ are turned to red. Moreover, for 
switching from one state to another, all traffic lights must be set to red for 
a time-period of A(^^®*"P(a;) = tuj due to security reasons [1]. These intervals 
correspond to a switching- or setup-time r (see Fig. 1). In conclusion, we 
obtain 

f^(A99-*"P + A^,) =27r. (2) 



2.2 Maximum oscillator frequency 



To fulfil the balance condition Eq. (1) we have to guarantee that the number 
of vehicles arriving during a cycle at the intersection is equal to the number 
of vehicles that can pass the intersection and depart. 

The instantaneous vehicular flow qi{'^) is given by the number of vehicles dni 
that 'potentially' arrive at traffic light / during ((/?, ip + which is equal to 
the time-shifted flow measured at a cross-section sufficiently far upstream the 
traffic hght. 

In the following we do not require any model for the dynamics of dqi thus the 
control concept is independent of the underlying traffic model. Since the traffic 
situation usually changes slowly compared to the period of a full switching 
cycle we assume the average flows qi = l/27r Jq"" qi{(p)d(p to be constant. The 
departure rate during green light is if there are waiting vehicles, and 
qi{(fi) otherwise. If the traffic light shows red, the departure rate is zero. As a 
consequence, we obtain a lower bound for the green time periods Ac/?^. 

Aip, > 2n max g^/gf"^. (3) 



Here qi/q]^^^ is the utilisation of the lanes, which are served during state s. For 
the signal control to function well, we require qi/qf^^^ <l.\i qi = g™^^ for some 
/ G Csi we have A<^s = 27r, which implies that state s must be set to green all 
the time in order to allow for the departure of all vehicles arriving from lane I. 
In this case, our synchronisation strategy would fail to switch to other states, 
while a purposeful operation of an intersection requires a switching through 
all S states in one cycle. 

The load of the whole intersection is determined by 
s 

^ = E ^ax qi/q^^. (4) 
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Additionally, the conditions imposed by Eq. (3) and Eq. (2) must be satisfied. 
This is guaranteed only if 

27r / \ 27r 

a;< — (^l-XJmaxgVgr^J u;^^ ^ - u) . (5) 

In other words, there exists an upper bound o;™^ for the switching frequency, 
determined by the amount of time which is spent on setups during a cycle 
while the balance condition Eq. (1) is fulfilled. For an increasing load u, the 
overall time for setups must be reduced relative to the duration of a cycle. 
This suggests to decrease o;™^^ for increasing loads u. If u = 1, the maximum 
frequency becomes o;™^ — 0. In this case, the intersection is blocked, since 
there exists no switching cycle which allows all arriving vehicles to depart. 
This is the typical behaviour of all queuing systems, if the inflow reaches the 
maximum capacity ^ . Small values of the load u allow for a higher maximum 
frequency cu"^'^^ and perhaps also a higher cycle frequency cu < a;™'^'^, which is 
in favour of smaller delays of vehicles. This is obvious, as the maximum delay 
time of a vehicle is given by the duration of a full cycle. 



3 Global coordination of intersections by synchronisation 

The objective of our decentralised control method is the network wide coordi- 
nation of the individual switching sequences based on a local coTipling between 
the intersections in the road network. By modelling each intersection i as an os- 
cillator, characterised by its phase-angle ipi and its effective frequency uji = (p, 
coordination is achieved by synchronising the oscillator network. Hereby, for 
providing a common time-scale and allowing the intersections to trigger the 
switching cycles right at the best time (see Sec. 4), we require a phase- locked 
state where the phase-difference between neighbouring oscillators is fixed [14]. 
Therefore, we suggest a coupling between any oscillator i = 1,2, ... N and its 
nearest neighbours j e Afi with adjustments of phases and frequencies on two 
different timescales. 

At first we consider the adaption of the phase- angle (pf. 

ifi = min { Qi{t) + ;1 5^ sin - } =: uj,{t) (6) 

where VLi is the inherent frequency. As long as uJi < 0;™^"", ipi tries to adjust to 
the neighbouring phase-angles ^pj. The constant corresponds to the typical 

^ In our case, the capacity of an intersection is determined by the maximum de- 
parture rates g™^, the switching times r and the partition {Cs}- 
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time-scale for this adaption. 

Beyond the phase-synchronising interaction given by sm{ipj{t) — ipi{t)), a sec- 
ond decentrahsed couphng can be used to increase the inherent frequencies to 
approach the possible maximum within a slow time-scale: 

minK.(i)} + AO - n,{t) ) . (7) 

Here the constant parameter AQ > provides a linear drift towards higher 
frequencies. 

3.1 Synchronisation dynamics and network size 

If the coupling mechanisms outlined above arc applied to a network of oscil- 
lators, two different adaptive behaviours of the system can be distinguished. 
Either, the system can evolve freely and increase the common frequency, i.e. 
a slow frequency adaption is possible. Otherwise, the possible dynamics of the 
coupled system is restricted by an intersection tQ, whose maximum frequency 
is reached. This requires the remaining oscillators to be frequency-locked to 
^max Pig 2 shows au example of both dynamical regimes which are discussed 
in the following. 

(i) Frequency adaption. 

As long as cUi < cuf^, a synchronised solution is obtained: 

(Pi{t) = if jit), ujiit) = fli{t), and Cli = ^ . (8) 

All oscillators have exactly the same phase-angle, while the frequencies Ui and 
Qi of all oscillators i increase linearly with time. As soon as any oscillator 
reaches its maximum frequency, however, Eq. (6) is dominated by a;™'^^ in the 
minimum function and cui will not increase anymore. Instead, the other state 
appears. 

(ii) Frequency-locked state. 

In this state, the effective frequency of the oscillator io with the global 
minimum of all maximum frequencies is locked to o;™^ = miuj/ o;™^. In order 
to achieve synchronisation, the effective frequencies uji of all oscillators must 
become cj™^^. Under suitable conditions derived below, the frequency- locked 
state has the solution 

a;. =a;-^ = minu;,'?^ and Qi ^ u^"^ + AQ Vi . (9) 
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The drift parameter AQ, which was in the previous state (i) responsible for 
increasing frequencies, must now be compensated by the phase-differences. 
Using Eqs. (6) and (9) leads to: 

J2 sin {^j{t) - ^pi{t)) = -T^ An yi^io. (10) 



Furthermore 



N 

J2Y.^^Mt)-v^iit)) = 0, (11) 

i=l jeAfi 



which is due to the anti-symmetry of the sin-function. Therefore, the phase- 
angles of the oscillator zq and its next neighbours j G must satisfy 

Y: sin {<pj{t) - <p,,{t)) ^ (N-l) An . (12) 



Considering an arbitrary network of N oscillators, there always exists a solu- 
tion for the immediate neighbours of io if 

{N -l)T^An < 1 . (13) 



A similar condition can be derived for the second-next neighbours and so 
forth, but for these, the factor in place of {N — 1) will become smaller and 
smaller. Therefore, Eq. (13) gives a sufficient condition for the existence of a 
phase-locked solution in the frequency-locked state (ii). 

Equation (13) exposes an compromise between large network sizes and a fast 
adapting behaviour. Increasing the network size requires a smaller adaption 
rate AO to ensure the synchronisation and vice versa. 

From a given initial condition, the system always converges to the phase-locked 
state (ii), see Fig. 2. It might temporarily enter the frequency adaptation state 
(i), where the common frequency grows in time to approach the frequency of 
the slowest oscillator. The transition between states (i) and (ii), which oc- 
curs when one of the oscillators reaches its maximum frequency, is smooth. 
There are no jump-like disturbances in effective frequencies and phase-angles. 
Once the system converges to state (ii), the synchronised frequency tightly 
follows variations of the global minimum of o;™^ frequencies. The phase- 
differences between neighbouring oscillators are almost constant. Thus, the 
phase-synchronisation establishes a load-adaptive common framework among 
the locally coupled oscillators, which can be used to coordinate the individual 
switching sequences on a network- wide level. 
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(ii) Frequency-locked 




Time t in sec 



Fig. 2. Simulation rcsTilts for a regular lattice road network, where the 5 x 5 in- 
tersections arc defined as oscillators with (a) a frequency (Jj and (b) a phase-angle 
<y9i. Based on a local coupling between immediate neighbours, all oscillators in the 
network synchronise globally by adjusting their phase-angles mutually. Left: Start- 
ing with a random initial condition, the system quickly approaches state (i) with 
a steadily growing common frequency and vanishing phase-differences. Right: As 
soon as the maximum possible common frequency is found (indicated by the hori- 
zontal dotted line), the system enters state (ii) with a locked common frequency and 
phase-differences exponentially converging towards constant values. {T^p = 300s, Tq 
= 60s, u;™^^^ = 27r/60s, AJ^/w™=^^ = lO'^, and = 25) 



4 Control of periodic traffic flows at a single intersection 



The time needed by a vehicle to traverse a series of roads controlled by traf- 
fic lights is given by the travel times between the intersections and the de- 
lay times at red lights. To minimise the overall travel time, or, to increase 
the throughput of the controlled network, wc shall minimise the delay times 
at every intersection. According to the synchronisation concept outlined in 
Sec. 3, each intersection i is provided with a phase-angle ipi, phase-locked to 
its neighbours and synchronised to a common frequency cu. Due to frequency 
synchronisation in steady state, the vehicular flows are basically periodic func- 
tions of the phase-angle ipi. Each intersection i may now independently adjust 
its switching sequence M : ip{t) s{t) based on the local arrivals of the vehi- 
cles. Thus, for clarity, we neglect the index i in this section and express time 
t in terms of </?. 

We shall answer the question, where in the cycle the state s should start, to 
minimise the total time that all vehicles may need to pass the intersection. 
Therefore, by ip^^'^ we denote the point where the subset Lg of traffic lights 
switches to red after a green time period A^j^. 

The delay of a single vehicle is given by the period between its arrival and 
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its departure A vehicle may arrive at the point Lp'^" = (pl^'^ + 2'Kp with 
< p < 1. Since the vehicles are not rearranged during the queuing process, 
it is expected to depart at ip^^"^ = 27i + ipl'^'^ — (1 — p)Aips. The resulting delay 
of the particular vehicle is therefore 

^dep _ ^arr ^ _ ^^^^^^ _ _ ^^^^ 

Integrating the delays of all vehicular flows Qsif) — Y^i&Cs served in a 
state s over a complete cycle gives the delays Dg imposed by the subset Cs of 
traffic lights as a function of ip^g'^ and A(ps'- 

1 

Ds{ip7\l^^s) = J (27r-A(^,)(l-p)g,((^f + 27rp)27rcip. (15) 



Now we have to minimise the overall delay 

D = j2Dsi^7'',^^s) (16) 

s=l 

produced by an intersection during a cycle. 

To identify the optimum value of (fl^'^ and A(fis for all Cg <Z Cwe consider the 
following two assumptions: 

(i) The sequence of states is given, e.g. by the order of their indices s = \ . . . S. 

(ii) The periods Aips are fixed and fulfil the conditions Eqs. (2) and (3). 
Then there remains only one degree of freedom, which can be expressed by the 
phase-angle ip^ that triggers the switching to state s = 1 (see Fig. 1). Thus, 
the end-point (p^^'^ of each state s becomes a function of (^°: 

^red^^O) ^^O^j- (^^^setup ^ ^^^^ 
s'=l 



Inserting Eq. (17) into Eq. (15) and using Eq. (16) provides us with a periodic 
function D{(p^) for the total delays D produced at the intersection given the 
start-phase (p^. With this function, the optimal start-phase 0^ can be found as 
D{(pP) = miUip /}((/?). The start-phase ip'^ can be shifted to the optimal value 
by an offset to the input argument of the map, e.g. s = M{ip{t) — Sip{t)). 

By adjusting the start-phases, a mutual adaption of the start times of green- 
phases at neighbouring intersections is reached. This will ensure a minimum 
delay for all vehicles which have to pass the intersection. Once the optimum 
is reached for two intersections, the switching sequence is repeated peri- 
odically until the traffic situation changes and a new optimum is obtained by 
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the control concept outlined above. Under certain circumstances, it results in 
emergent green waves. 



5 Conclusions 

In this paper we have developed a method to reach coordination among the 
traffic lights of an urban street network. This method is based on a combi- 
nation of a synchronisation resulting from local interactions and a pure local 
optimisation: 

(1) At each intersection, the maximum frequency is determined that allows 
one to clear the queues on the incoming road sections within one switching 
cycle. This frequency is given by Eq. (5) in dependence of the respective 
road utilisation. 

(2) The signal controls of all intersections are eventually adjusted to the 
minimum of all these frequencies, based on a coupling of neighbouring 
signals. A decentralised method of adjustment is described by Eq. (6). 
Thereby, all intersections of the road network continuously equalise the 
period of their switching cycles. Thus, the switching sequences and the 
arrivals rates of the vehicles at all intersections become periodic functions. 

(3) It is always tried to increase this frequency in order to reduce the waiting 
times of vehicles in queues. This is reached by introducing a constant 
drift, see Eq. (7). 

(4) Each cycle is subdivided into different green-phases and setup-times as 
illustrated in Fig. 1. Note that, within one switching cycle, some roads 

may be served several times. 

(5) The optimal green-phases are obtained by minimising the objective func- 
tion (16). If a periodic sequence of green lights is used, the optimisation 
problem becomes a minimisation of a continuous function with a single 
parameter i^^. In order to minimise the waiting times of vehicles during 
red light, the model presented in Sec. 4 determines the optimal start- 
phase (fP of the switching sequence for each intersection. 

Under suitable conditions, our concept allows for the emergence of green waves. 
Let's consider the example of a single main road with several intersections and 
different average flow rates in both directions. Then, the vehicles belonging 
to the highest traffic flow will always have a green light except for the very 
first traffic light where the vehicles queued are bundled. The green wave will 
propagate with the largest group of vehicles. 

Although our method is quite promising, it has also some limitations: First, 
the method for determining the maximum frequencies a;™*" needs to be ex- 
tended for practical application: In real traffic networks, it is possible that 
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the traffic arriving at an intersection exceeds capacity. In this case, it is not 
possible to remove ah waiting vehicles within one cycle. Within the framework 
outlined above, the intersection would be just blocked. However, this situation 
can be easily avoided by defining a global minimum of the allowed switching 
frequencies. If the overload situation occurs temporarily, such a minimum fre- 
quency will still guarantee a stable functioning of the concept, but it can not 
avoid queues that persist for more than one switching cycle. Furthermore, to 
dissolve existing queues quickly and to increase the robustness with respect 
to stochastic variations in the average flow rates, the maximum frequencies 
could be assigned a smaller value than determined by Eq. (5). 
Second, the frequency of the synchronised system is likely to decrease with 
growing system size, so that waiting times can become quite long. Therefore, 
synchronisation cannot be the only goal in signal control. Instead, it would 
make sense to break up a large synchronised system into smaller synchro- 
nised clusters, which may change their shape and size in the course of time. 
It would also be reasonable to change the order of green-phases sometimes in 
response to different traffic patterns (e.g. inbound or outbound traffic during 
the morning and afternoon rush hours, respectively). 

Nevertheless, it is useful to have a method for a self-organised coordination 
of traffic or material flows in a network, based on local interactions. The next 
step will be to couple this approach with a concrete simulation of the dynamics 
of material flows and queue formation in the system, as proposed in Ref. [2] . 

In summary, the optimal switching of traffic lights in non-trivial road net- 
works is one of the most complex material flow control problems. However, 
the problem in most material flow networks is similar. In production and man- 
ufacturing: road sections in traffic correspond to buffers in production, travel 
and delay times to cycle or production times, junctions to processing units, 
and different origin-destination flows in road networks to different product 
flows. Thus, our approach is easily transferable to the control of production 
systems or other material flow networks. It is particularly suited for systems 
of moderate size and load, which applies to many manufacturing systems. 
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